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I ■ I. INTRODUCTION 

Quite recently, it has been realized that the study of the structure of networks, which was formerly "a private 
, domain" of mathematical graph theory jl]j|J Lis actually a field of statistical physics j|||Jl,@,i|,§l • Most achievements 
of physicists in the field of random networks [ 10| (structural and topological aspects) are empirical findings and simple 
ideas, which were demonstrated by using very particular models. One of main questions that arise is: What is the 
nature of complex, non-Poisson degree distributions, which were observed in many real networks? (Degree of a vertex 
is the total number of its connections.) However, few efforts were made to develop a general statistical theory of 
networks (see Refs. |l^Jl^,|l^,|T^] ) . Without such a theory, the above question cannot be answered. Furthermore, the 
' structure of the statistical theory of random networks can be related to a zero-dimensional field theory and to a mean- 
field description of simplicial gravity Jig ]. A condensation phase transition, which occurs in equilibrium networks, is 
close to that which occurs in branched polymers fl6|,[l7j ■ 

In this paper we focus on equilibrium network ensembles, which are less studied. We construct statistical ensembles 
H ' of random uncorrelated networks in a natural way and establish a one-to-one correspondence between them and 
t-H I known construction procedures. One of conclusions is that, in equilibrium networks, fat-tailed degree distributions (in 
~^ . particular, power-law ones) are possible only starting from some critical value of the average degree. Above this critical 
point, a finite fraction of edges are in a "condensed state" , i.e. are attached to an infinitely small fraction of vertices. 
This situation for equilibrium networks contrasts with that for growing ones, were fat-tailed degree distributions are 
realized over a wide range of a control parameter without any condensate. 

The keystone of network science are construction procedures. Erdos and Renyi constructed ensembles of random 
graphs with a Poisson degree distribution by adding edges at random to a fixed number of vertices [Q. When the 
total number of edges L is fixed, this provides a canonical ensemble. When one fixes the probability that two vertices 
I ■ are connected, the procedure produces a grand canonical ensemble. 

To obtain equilibrium random graphs with an arbitrary degree distribution II (q) , a different statistical ensemble 
was introduced |3| (see also Ref. ]l^|). Roughly speaking, these are graphs, maximally random under the restriction 
that their degree distribution is equal to a given II (q) (see below). Here we demonstrate that this "static" construction 
produces a microcanonical ensemble, and construct equivalent (in the thermodynamic limit, i.e. N — > oo) canonical 
and grand canonical ensembles as limiting equilibrium states of simple dynamical processes. 

In statistical mechanics, equilibrium ensembles arise as infinite-time limiting distributions of some ergodic dynamics. 
Here we present naturally looking graph evolution models, using the generalization of the concept of "preferential 
linking" , which was introduced in Q . We consider two kinds of a random network evolving under the mechanism 
of preferential linking and displaying ergodic behavior. The latter means that an evolving ensemble finally becomes 
equilibrium, and final statistical weights for the complete set of graphs of the ensemble are independent of time 
and initial state. The specific rule of preferential linking that we use allows us to construct equilibrium statistical 
ensembles with an arbitrary n (g) . 

The paper is organized as follows. In Section [n] we introduce the main notions of random graph theory. The next 



Section [II is a key one: we establish a connection between ergodic evolution and statistical ensembles for undirected 
graphs. In Section [V these results are generalized to the case of directed graphs. Section |v| is devoted to networks 
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with a fat-tailed degree distribution, decaying slower than exponential. The results are discussed in the last Section 
VI. Technical details are described in three Appendices. 



II. DEFINITIONS AND MAIN NOTIONS 

A graph g is a set of N vertices connected by L edges, directed or undirected. It may be displayed as a set of points, 
with some pairs connected by one or more lines, with or without arrows. For analytic purposes, a graph is represented 
by an N x N adjacency matrix g, whose elements gij are numbers of edges connecting vertices i and j. 

An undirected graph (with undirected edges), is represented by a symmetric adjacency matrix, gij — gji. In this 
case it is convenient to set diagonal elements gu to be equal to twice the number of unit-length loops. Then, the 
adjacency matrix of an undirected graph G\, obtained from a directed graph G with an adjacency matrix g by 
replacing all directed edges with undirected ones, is simply gQ' = gij + gji- 

Mayer's graphs are the ones without multiple connections and one- vertex loops. Their adjacency matrix elements 
satisfy the conditions: = gij, gu = 0. 

Vertex in-degree ri of a vertex i in a directed graph is a number of incoming edges of the vertex i, r*j = Ylj9ij- 
Similarly, out-degree Sf is a number of edges, outgoing from the vertex i, Sj = Y) ^ g^. Vertex degree for undirected 
graph is q, = £\ ;/, , = V , 

A statistical ensemble of graphs is defined by choosing of a set G of graphs and a rule that associates some statistical 
weight (unnormalized measure) P(g) > with any graph g £ G. Then the ensemble average of any quantity A (g) that 
depends on properties of a graph is (A) = Z^ 1 J2 g eG A (flO P (s0> where Z is a partition function, Z = X) 9 6G P (fl 1 )- 
For instance, let A (g) be the total number of vertices of in-degree r and out-degree s: 

N 

N(r,s;g)=Y / S[n(g)-r]5[s i (9)-s} . (1) 

Here N is the total number of vertices in the graph g (we consider only ensembles with a fixed number of vertices). 
The probability that a randomly chosen vertex has in-degree r and out-degree s (a degree distribution) is 

II (r, a) = {N{ ^ S)) = 1 / S [n (g) - r] S [ Si (g) - A (2) 
For an undirected graph, one can define the number of vertices with a given degree q 

N 

N(q) = '£S[q i (g)-q], (3) 

i=l 

and a degree distribution 

In this paper we consider statistical ensembles with non-Mayer's graphs allowed. The advantage of this assumption 
is that one can associate a statistical weight with a graph by using the same rules, as for the contribution of the 
corresponding Feynman diagram in an appropriately chosen zero-dimensional field theory (see [|ll|]l2| l). 

Note that we consider labeled graphs. That is, two graphs, g and g' , which differ only by numeration of vertices, 
are treated as different ones. 



III. EVOLUTION OF GRAPHS AND STATISTICAL ENSEMBLES: UNDIRECTED GRAPHS 

In this section we discuss how ensembles of undirected graphs arise as a result of the network evolution. For 
simplicity, we restrict ourselves to undirected graphs — generalization to the case of directed ones is presented in the 
next section. We define the statistical weights of the canonical and grand canonical ensembles of random networks as 
a limiting equilibrium distribution of a process, during which one graph g G G of the ensemble transforms to another 
graph g' £ G with probability W (</, g) dt. The statistical weights P (g, t) evolve according to the master equation 
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d t P (g, t) = Y, [W (<?, g') P (g\ t)-W (g', g) P (g, t)} . (5) 

g'&G 

An equilibrium ensemble is a stationary one. P(g,t) = P(g) is independent of t, where statistical weights are 
determined by the detailed balance condition (absence of "currents"): 

W(g,g')P(g') = W(g',g)P(g). (6) 

This equilibrium ensemble exists if and only if the set of "hopping rates" W(g, g 1 ) satisfies two conditions: (i) For any 
pair of graphs g, g' € G, there exists a sequence of graphs g\, g 2 , . . .g n E G such that 

W(g',g n )W(g n ,g n ^) . . . W(g 2 , gi)W( 9l , g) £ 0. (7) 

(ii) For any sequence of graphs <?i, <?2> • • -9n € G, the equality: 

W(g l7 g 2 )W(g 2 ,g 3 ) . ..W(g n - 1 ,g n )W(g n ,g 1 ) = W (g x , g n )W (g n , g n - X ) . . ■ W(g 3 ,g 2 )W(g 2 ,g 1 ) , (8) 

is valid. 

These conditions ensure that (a) ascribing an arbitrary statistical weight to some graph, one can obtain statistical 
weights of all other graphs up to a constant multiple, and (b) this definition is unambiguous: the weights are indepen- 
dent of the ways connecting initial graph with all the other ones. To satisfy condition (ii), it is sufficient to assume 
the factorization: 



W(g , ,g) = V f (g , )V i (g). (9) 

Our dynamical constructions, which are presented below, satisfy this condition. We use simple natural assumptions 
about the evolution rates W (g', g), but our choice is not unique (e.g., see a "Metropolis algorithm" from Refs. |Ii|JL2|| ). 

We consider the following equilibrium statistical ensembles of graphs with a fixed total number of vertices N. A 
statistical ensemble is a set of graphs G plus rules that determine statistical weighs P (g) for all graphs g € G. 

1. A microcanonical ensemble 

(set) Let N (q) be a sequence of non-negative integers such that < J2 q N(q) = N < oo. Gmc is the set of all 
graphs of size N, for which number of vertices of degree q is equal to N (q). 

(rule) To each graph g 6 Gmc ascribe the weight 

N ! N 1 

PMc(g) = N- L J[^ T J] — . (io) 



This is a "static" construction. These statistical weights follow from pure combinatorics. They are just the number 
of possible ways to obtain a given graph g £ Gmc by connecting together N vertices with degrees qi,q 2 , ■ ■ - Qn (see 
proof in Appendix A). The multiple N~ L is introduced to ensure the extensiveness of the "free energy", In Zmc- Eq. 
( |l0| ) implies, that edges in the graph are distinguishable. Note that if only Mayer graphs are allowed, all graphs in 
this ensemble have equal weights. In the thermodynamic limit JXSj ] , the microcanonical ensemble is described by a 
sequence of values {II (q)} or, which is the same, {N (q)} (in particular, this includes the mean degree q <— 2L/N). 

To construct canonical and grand canonical ensembles we use the processes of rewiring |20| or of deletion/creation 
of edges pi] , and the idea of preferential linking |I|22 ; 2j|. We assume that the probability that an edge becomes 
attached to a vertex i depends only on the degree (fo of this vertex. This probability is determined by some preference 
function / (q). 

2. A canonical ensemble. 



(set) The set Gc consists of all graphs with N vertices and L edges. 

(rule) At each step of the evolution, one of the ends of a randomly chosen edge is rewired to a preferentially chosen 
vertex k. Let the rate of this process be f (qk) [0- The limiting stationary statistical weights give Pc(g)- 
In the thermodynamic limit, the canonical ensemble is described by {/ (q)} and q *— 2L/N. Note that the 
multiplication of f (q) by a constant, /(g) — > Cf(q), is simply the rescaling of time, t — * t/C. It does not 
influence equilibrium properties. 
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3. A grand canonical ensemble. 
(set) The set Gqc consists of all graphs with any number of edges and a fixed number of vertices, N. 

(rule) There are two parallel processes in this case: edges are deleted and emerge permanently. Randomly chosen edges 
are deleted at a rate XN (X is the inverse lifetime of an edge, A is fixed as N — > oo, i.e., in the thermodynamic 
limit). Edges between vertices i and j emerge at a rate f(qi)f(qj)- To ensure the correspondence with the 
canonical ensemble, let the deletion rate of tadpoles be 2AiV. 

In the thermodynamic limit, the grand canonical ensemble is described by {/ (q)} and A. 

Let us obtain, for example, statistical weights for the canonical ensemble. Let an edge (i, j) of a graph g be rewired 
to (i, k) in a graph g' . We have the following balance equation for the statistical weights of these two graphs: 

g'ikf («£•) Pc (9') = 9ijf (q k ) Pc (9) • (11) 

Here quantities with a prime mark are referred to the graph g', q'j = qj — I, g' ik = g^ + 1 + 5^ (adding a tadpole 
increases gu by two). The multiple gij is present, because rewiring any of (i,j) edges gives the same result. One can 
look for the solution in the form: 

N N 

Pc (9) = N- L JJpfo) X d (gu) I] X (9jk) , (12) 

z=l j<k=l 



where p, x and Xd are some functions of an integer argument. Substituting Eq. (12) into Eq. (|l l|) , we obtain at i =/= j, 
i^k: p(q+l) = f{q)p(q), x (g+l) = X (ff) / (9 + !)• Setting i = j or i = k, we get: X d (g + 2) = X d (g)/(g + 2). 
The constant multiple N~ L is introduced to ensure the "free energy" to be extensive variable, InZc ~ N. Thus we 
obtain: 

9-1 

p(s) =n-fw f ° r 3 >o ' p(°) =i ' 

x(g) = -7' Xd(g) = -4- (13) 



Then we have 



Pc(9) = N^Y[ P -M n — "j • (14) 



Comparing Eq. ( |14|) with Eq. (|10|), one can see that 



iV 



Pc(g) = PMc(9)l[ E ^r- ( 15 ) 

J -- L 



Analogously, for the grand canonical ensemble we have 

N 



P GC (g) = (AtfT £W II ^TT II A = ^ • ( 16 ) 

where p (q) is again given by Eq. (|l3|). Here £(5) is the number of edges in a graph g. 

One can present the statistical weights in a different form. For the canonical ensemble, one can write 



JV 



p c(9) = ll^ n ^T ex P 
i=l »«•• J<fc=l yj fc - 



5^JV(g,fl) lnp(<z) 

.9=0 



(17) 



The corresponding form for the grand canonical ensemble includes the additional term —L (g) In (XN) in the expo- 
nential: 
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P oc(9) = U^ II 77T ex P 



n Oil - - . 



-L{g)\n{\N)+Y,N{q,g)\np(q) 

9=0 



(18) 



The above constructions are reasonable only if these ensembles are equivalent in the thermodynamic limit. Here 
we show that this is the case. One can see from Eq. dl7| ) that statistical weights of graphs with the same 
sequences {N(q,g), q = 0, 1, 2, . . .} are equal. Then the canonical ensemble is equivalent to the microcanonical 
one with the same II(q) = (N (q)) /N if fluctuations of N (q) are negligibly small in the thermodynamic limit: 

(N 2 (q)) - (N(q)) / (N (q)) -> as N -> oo. To study these fluctuations, one may use the following standard 

relations: 



5\nZ({p(q)}) 
Slnp(q) 



= (N(q)) 



5 2 In Z({p(q)}) 
Ship (q) S hip (q 1 ) 



(N(q)N(qi))-(N(q))(N(q>)) , 



(19) 



which follows from Eq. (|17|) and the definition of the partition function. Equation ( |19| ) holds both for the canonical 
and the grand canonical ensembles. 

Notice that the transition from a microcanonical ensemble to canonical one is basically the Legendre transform p5| , 
where some thermodynamically conjugated fields are used. In our case, the microcanonical ensemble is characterized 
by a sequence of {N(q)}, and the conjugated fields are {\np(q)}. In the grand canonical ensemble, — In (XN) is 
analogous to a standard chemical potential or, more precisely, to fi/kT. 

The partition function of the grand canonical ensemble is 



Z GC (TV, A, {p (q)}) = J2 ^ Lz c (N, L, {p (q)}) 



L=0 



Let us introduce a zero-dimensional theory of real scalar field x with the action [[ll[|l 

A 



S{x) 



-x A - >i§ (x) , 



where 



p (g) ^ 



(20) 



(21) 



(22) 



Then the generating functional of this theory can be expanded in the series of all possible Feynman diagrams, whose 
contributions coincide with statistical weights: 



' o — OO j\r r 



Z(A,x,{p(q)}) 
Then we come to the expression 

Z GC (N,X,{p(q)}) = 
From Eq. @ it follows that 

Z c {N,L,{p(q)}) 



N=0 



dx exp 



(-*) 
Nl 



N 



^GC 



(N,A/N,{p(q)}) 



NX 



[$(x)] 



iV 



c 



dX 
2vri 



A^- 1 Z GC (iV,A) , 



(23) 



(24) 



(25) 



where the integration contour C has no singularities outside of it. Substituting Eq. (g4|) into Eq. (|25|), changing the 
order of integration, and calculating the integral over A, we have 



Z c (N,L,{p(q)}) = N- L (2Z-1)!! 



(26) 
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where the contour c encircles the point x = 0. This derivation is rather formal, because convergence of the integrals 



for the generating functional Z, Eq. (P3|), and for the grand canonical partition functions, Eq. (24), depends on the 
properties of $ (x). These integrals are well defined and converge if the diagrammatic series for the corresponding 
partition functions, or for the generating functional, converge. Note that the partition function of the grand canonical 
ensemble does not exist if either ln$ (x) is growing faster than x 2 at x — ► oo, or <I> (x) has singularities at the real 
axis (series (^2|) has a finite radius of convergence). But for the canonical ensemble, the partition function does exist 
for every $ (x), which is analytic at x — 0. Indeed, for the canonical ensemble, the partition function is a sum over a 
finite set of graphs, while for the grand canonical ensemble, it is an infinite series, which may diverge. More detailed 
derivation of Eqs. (|24|) and ( p6| ) is presented in Appendix B. Note also that the expression ( |2^ ) coincides with that 
for the partition function of the backgammon ( "balls in boxes" ) model . 
As iV — > oo, one can use the saddle point expression: 

Z C (N, L, {p («,)}) - [$ (x s )] N , (27) 

where q — 2L/N is the average vertex degree and the saddle point x s is given by the equation 

9 (28) 

We omitted a preexponential saddle-point multiple in Eq. (|27j) as insignificant in the thermodynamic limit. For grand 
canonical ensemble we have: 

Z GC (N , A, {p (q)}) = cxp (~<4) [* (*.)]" > (29) 



Axs = ■ ( 3 °) 

From the fact that the logarithm of the partition function of the canonical ensemble is extensive, In Zqc ~ N (see 
Eqs. @ and @), it follows that (N (q) N (q')) - (N (q)) (N (q')} = O (N), so that the canonical ensemble is indeed 



equivalent to the microcanonical one. Analogously, using the relations 

d In Z GC 



(L) = 



9 In A 



^- (i)2 = w = ° (JV) ' (31) 

one finds that the fluctuations of the number of edges L in the grand canonical ensemble disappear in the thermo- 
dynamic limit. This demonstrates the equivalence of the grand canonical and canonical ensembles, if / (g) grows 
not very fast with g, which allows the existence of the grand canonical ensemble. Their parameters are related as: 
A = Lx 2 s /N = nxl. 

From Eqs. @, (§|) and one sees that 

N q\${x s ) 



This is valid for both the canonical and grand canonical ensembles. Note that Eq. ( |32[ ) may be also derived directly 
from the evolution equation for the degree distribution (see Appendix C). Equations ( p8| ) or (|30|), and ( |32| ) fix the 
one-to-one correspondence between the degree distribution II (g), which determines the microcanonical ensemble, and 
the set of parameters (g, {/(g)}) or, equivalently, (q,{p(q)}) (see Eq. (|l3|)). From Eqs. ( |l3| ) and (p2]), it follows 
n (g + 1) /II (g) = / (g) x s J (q + 1). Then one can correspond the microcanonical ensemble which is described by a 
degree distribution n (g) with the canonical and grand canonical ensembles characterized by (i) 

/(g) = (g + l) n ^ ( + 1) , (33) 

(/ (g) is defined up to an arbitrary multiple), and (ii) by g = J2 q (<z) f° r the canonical ensemble, or A = g for the 
grand canonical one. 
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IV. GENERALIZATION TO THE CASE OF DIRECTED GRAPHS 



A microcanonical ensemble of directed graphs is characterized by a distribution function II (r, s) , which is the prob- 
ability that a randomly chosen vertex has in-degree r and out-degree s. More precisely, one must define non- negative 
integers N n (r, s) with the following properties: < N n = J2 r a ( r ' s ) < 00 > ^ n ~* 00 an( ^ ^ n ( r ' s ) l^n — > H (r, s) as 
?i — * 00. For a directed graph, we also must require, that total in- and out-degrees are equal: ^ r s (r — s) N n (r, s) = 0. 
Then for each n, we introduce the ensemble of directed graphs with N n (r, s) vertices of in-degree r and out-degree s, 
N n vertices in total, connected in all possible ways. To each this graph g, we ascribe for a statistical weight equal to 
the number of possible ways to construct the graph g: 

N N 

PMc(g) = l[r i \s i \ II — r ( 34 ) 

i=l j,k=l * fe ' 

The limit of such a sequence at n — > 00 would be the microcanonical ensemble with a given degree distribution II (r, s). 

Canonical and grand canonical ensembles may be introduced quite analogously to what it had been done for 
undirected graphs. For example, the canonical ensemble may be introduced by using the process of rewiring one 
end of an edge. There are two differences from the undirected graph constructions: (i) we introduce two generalized 
preferential attachment functions, /1 for rewiring the outgoing end of an edge, and f% for rewiring the incoming end, 
and (ii) in general, these function depend on both the in- and out-degrees of the destination vertex. Applying detailed 
balance conditions for transitions between graphs g\ and g 2 (edge i — > j rewires to i — + k), and between graphs g% 
and (74 (edge i <— j rewires to i <— k), we obtain the relations: 

$h (rf\sf) P C ( 92 ) = 4>A (r« P C ( 91 ) , 

flg 5 = *§> - 1 . flg 1 = ^ + 1 ■ = rf - 1 , S f = S f > , rj?> = r« + !,.?> = i (35) 
^ (rf, S f) Pc (*) = (r£\ 4 3) ) ( 5 a) , 

ffff - *£? + 1 , gf = $ ~ 1 ,rf = rf , S f = S f - 1 , = rf , S [ 2) = •?> + 1 • (36) 
One can look for the solution of the above equations in the form: 

N N 

Pc(g) = l[p(n,s l ) H x(g 3 k) ■ (37) 

Then we have: 

p (r + 1, s) = /1 (r, s) p (r, s) , p (r, s + 1) = / 2 (r, s) p (r, s) ; (38) 

x(s + i)=^rj- (39) 

Applying subsequently Eqs. (|3^) in different order, we have: 

p(r + l,s + 1) = /1 (r, s + 1) / 2 (r, s)p(r,s) = / 2 (r + 1, s) /1 (r, s)p(r,s) . 

This means that the preferential linking functions /1 and f 2 cannot be chosen arbitrary but must satisfy the condition 

fi (r, a) h (r, s + 1) = fi (r + 1, s) f 2 (r, a) , (40) 

which is actually a consequence of the detailed balance condition (|J) . 

The solution of Eqs. (|3^) is constructed in the following way. Let us consider a 2D square lattice. We associate 
fi (r, s) with each horizontal bond connecting sites (r, s) and (r + 1, s), and associate f 2 (r, s) with the vertical bond, 
connecting sites (r, s) and (r, s 4- 1). Let C be some path connecting points (0,0) with (r,s). Then, 

p(r,*)=p(0,0)IJ/a(P.*)- ( 41 ) 

Here (p, a) are coordinates of points along the path C, a = 1 (2) for the horizontal (vertical) direction, and d = +1 (—1) 
if the bond is passed in its positive (negative) direction. The condition ensures the independence of the product 
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in Eq. ( |4l| ) of the path C. In fact, this is the condition of the potentiality (zero vorticity) of the vector field ln/ a 
defined on the square lattice. Then \np is a potential for this field, that is ln/ Q is a lattice gradient of Inp (see Eq. 
(p8h). The arbitrary multiple p(0,0) may be set, e.g., to 1. Solution of Eq. (|3S|) is simple: 



X(j9) = j r (42) 

The grand canonical ensemble may be constructed quite analogously to what it had been done for undirected graphs. 
Two opposite processes are introduced: one is of edge creation, at a rate f% (u, s,) /i (rj,Sj) for the edge, going from 
the vertex i to j, the other is of the edge removal, at a rate \N. Again, fi and /2 must satisfy the condition (|4Cl| ) to 
ensure the equilibrium character of a stationary state. The statistical weight of a graph is given by the expression 



Pgc (g) = e- AL(s) f[ P (n, Sl ) J] ~~i • (43) 

i=l j,k=l ^ fc ' 



The derivation of the integral representation of the partition function is quite similar to that for undirected graphs, 
but Feynman's diagrams with directed lines now are generated by complex fields. We introduce a complex scalar field 
x, and write the action: 

S (x, x*) = -A \x\ 2 - (x, x*) , (44) 

r.s— 

Then the following generating functional of this field theory will produce all possible graphs with any number of 
vertices as its Feynman diagrams. Their contributions are the same as statistical weights of graphs in the grand 
canonical ensemble ( ff3|) with A = A/N, except the additional multiples {—x) N /N\. Therefore, one can write: 

A f °° (— ) N 

Z(x,A,{p(r,s)}) = - dxdx* ex P S(x,x*) = £ ~^T z gc (N, A/N, {p (r, a)}) , (46) 

77 J N=0 

where the integration is over the entire complex plane (compare with Eq. J23|)). Therefore, 

Z GC (N, A, {p (r, s)}) = ^ J dxdx* exp (-NX \x\ 2 ) [$ (x, x*)] N . (47) 

In Eqs. (|4^), ( |47| ) one should treat x and x* as independent integration variables when actually calculating the 
integrals. The partition function of the canonical ensemble is given by 

Z C (N, L, {P (r, .)}) = ^ £ ti f C2 2S t $ & ' ( 48 ) 

where the integration contours encircle points x = 0, y = 0, respectively. The derivation of Eq. ( f48| ) is quite 
similar to that of Eq. ( p6|) for undirected graphs. 

Again, in the thermodynamic limit, N — > 00, L — > 00, 2L/N — > one can use a saddle point approximation, which 
gives 

Z C (N, L, {p (r, s)}) -> f-?-) [$ (as., tf,)]^ , (49) 
\ex s y s J 

where x s and y s are defined from the stationary point equations: 

d\n<$>(x s ,y s ) dln<P(x s ,y s ) 

q = x s =y s . (50) 

dx s dy s 

For the grand canonical ensemble, we have 

Z GC (N, A, {p (r, a)}) - exp (-iVAa; s y s ) [$ (a:., y,)]^ , (51) 
where the saddle point coordinates x s and y s are determined from the equations: 
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dki$(x s ,y s ) dln$(x s ,y s ) 

A2/ s = 5 , Aa; s = . (52) 

dx s dy s 

The degree distribution both for the canonical and grand canonical ensembles is defined by 

n (r . ,) - M - "'"'f - , (53, 

jV ivo In p (r, s) r!s! 

where the last relation is valid in the thermodynamic limit. Eqs. (|53|), (50) and ( (4l|) establish correspondence 
between the microcanonical ensemble with the degree distribution II (r, s) and the canonical one, characterized by the 
preferential linking functions fx,2 and the mean vertex degree q. The parameters of the canonical and grand canonical 
ensembles with the same degree distribution are related as 

q = Xx s y s . (54) 

This relation follows from Eqs. ([30|) and d52|). 

Again, as it was for undirected graphs, the canonical ensemble does exist for every p(r,s), provided that power 
series ( ff5| ) has finite radii of convergence on both x and y. Conditions for the existence of the grand canonical ensemble 
are essentially more strict: the integral in Eq. (fo) must be well defined and convergent. 



V. FAT- TAILED DEGREE DISTRIBUTIONS 



In this section we shall consider in detail properties of the canonical ensembles of graphs, which arise if a preference 
function f(q) grows rapidly enough. 

For brevity, we focus on the undirected graphs. The generalization to the ensembles of directed graphs is straight- 
forward. 

As one can see from Eq. (^4|), the grand canonical ensemble does not exist in two cases. In the first case the 
integral, representing the partition function, diverges, since the function <I> (x) grows fast enough at x — ► ±00. In the 
second case, the integral is not determined, because $ (x) has a singularity on the real axis. In both the situations 
we have degree distributions, which decay relatively slowly as q — > 00. Let us begin with the case, when $ (x) has no 
singularities, but ln$ (x) grows faster than x 2 as |x| — > 00. 

Using Eqs. (p2|) and (p2|), one can write the following relation: 

that is <£> (x) is expressed in terms of the Z-transform of II (q). Using the formula for the inverse of Z-transform, we 
obtain 

I dx (x a \i &(x) 

For finding the relation between the asymptotic behaviours of $ (x) and II (q) , let us use a saddle point approximation 
in Eq. (|5q). It is convenient to set $ (x) = exp<fi(x). The equation for the saddle point x a is q — x a (f>' (x a ). Then the 
asymptotic expression for II (q) is 

n (g) - {2vx a [x a 4>" (x a ) - (x a W 1/2 (^j q exp [</> (x a ) - <j> {x s )\ (57) 

The integral for the grand canonical partition function in Eq. (24) is divergent, if <j>{x) grows as x 2 or faster at 
x — > 00. Assume that 4>( x ) ~ * Ax^ 1 as x — > 00. Then the saddle point equation is q = A^x^, and x a — > (q/Afi) 1 ^. 
Omitting irrelevant multiples, we have from Eq. (57): 

n(q)^(2n q y 1/2 ~ir(q)r 1/f * . (58) 
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Thus, if the degree distribution II (q) decays slower than [r (q)] as q — > oo, then the partition function of the 
corresponding grand canonical ensemble diverges. 







The reason for this divergence is that we have admitted the existence of non-Mayer's graphs. Indeed, let us choose 
some pair of vertices in a graph. Let us add more and more edges connecting this pair. The statistical weight of the 
graph with v edges between this pair contains multiple p (qi)p (qj) f^ijU where = i/y + const, qj = + const. One 
can easily conclude that the statistical weights approach as v — > oo only if p 2 (q) /ql — > 0, or y/qlH (q) — > 0. The 
same result may be attained if we consider a sequence of graphs obtained by subsequent addition of closed loops to a 
chosen vertex. This result may also be presented in the different way: if the preference function f (q) — p{q + 1) jp (q) 
grows faster than y/q at large q, then the partition function of the grand canonical ensemble diverges. 

The radius of convergence of the series expansion (E2) is 



R c = lim -^—j — -^rj- = lim ^ ' ~\ , . (59) 

q^oa p{q+l) q^oo f [q) 

If / (<?) grows as q — > 00 slower than a linear function, then R c — 00. In this case $ (x) has no singularities at all. 
This means that (i) the partition function of the canonical ensemble may be expressed in the form (p6|), and (ii) in 
the thermodynamic limit, one can use for this function its saddle point expression, Eqs. ( p7| ) and (|2^). If / (q) grows 
faster than a linear function, then R c = 0. This means that although the canonical ensemble exists (the canonical 
ensemble always exists, because it is represented by a finite set of graphs at any finite N and L), its partition function 
can not be written in the form of the integral representation ( p6| ) . Actually, this means the absence of any meaningful 
thermodynamic limit. 

The interesting case is < R c < 00. In this case, the partition function of the canonical ensemble can be expressed 
as an integral, but the saddle point expression for this integral may not be longer valid. The saddle point expression 
is not valid at a large enough number of edges in the network, when the saddle point approaches the position of 
singularity. We show that in this situation, "fat-tailed" degree distributions, i.e. ones decreasing slower than an 
exponent, may arise. 

Without any lack of generality, one can set R c = 1 in this case. This is equivalent to / (q) = q + o(q) as q — > 00. 
In Eq. ( p8| ) its right hand side is a monotonously increasing function of x 8 . This means that as q = 2L/N grows, 
x s grows too. As x s < R c — 1, the degree distribution contains exponentially decaying multiple x\. There are two 
possibilities depending on the character of the singularity of <I> (x) at x = 1: either $' (x s ) — + 00, or it approaches 
some finite value as x s — > 00. In the former case, again there are two possibilities: either lim^^i $ (x) is finite, or this 
limit is infinite. If $ (1) is finite (but (1) is infinite), then the degree distribution approaches some limiting form as 
q — > 00, and the first moment of this limiting distribution diverges. This means that such a degree distribution can 
not be realized in any canonical ensemble with a finite number of edges per vertex. To construct networks with such 
a distribution, one has to change the conditions of the thermodynamic limit transition in the canonical ensemble, 
assuming N — > 00, L — > 00 and q = 2L/N — > 00, instead of keeping q fixed. Another way is to use a microcanonical 
ensemble. If $ (1) is infinite, no normalizable degree distribution without an exponential cut-off is possible. 

Now, let us consider the case (1) < 00. The degree distribution becomes "fat-tailed" when x s = 1, which takes 
place when q — q c — $' (1) /$ (1). If q > q c , the saddle point equation ( |28| ) has no solution < x s < 1. In this case, 
in the thermodynamic limit, the partition function remains the same up to a preexponential factor as for q = q c . 
Indeed, let us rewrite Eq. (|26|) as 



Z C (N, L, {p (q)}) = N- L (2L - 1)!! / [x~^ (x)] N . (60) 

J c 2mx L J 

To calculate a large N asymptotics one has to deform the integration contour into the steepest descent one, intercepting 
the real axis at the point, where (x) is minimal within the interval (0, 1), and going along the line of the constant 

(i.e. zero) imaginary part. If q < q c , this is a usual saddle-point contour, crossing the real axis perpendicularly at 
some point x s < 1. If q > q c , this contour consists of two complex conjugate parts meeting always at x = 1. 
As q grows, the point, where the integrand is maximal, x s — 1, does not move. The only change is that the two 
branches of the contour become closer and closer to the real axis in the vicinity of x = 1 at x > 1. But it is x s 
and $ (x s ) that determine the value of the main (extensive) contribution to the logarithm of the partition function: 
In Zc = —L\n(qx s ) + N ln<I> (x s ) +o(N). The extensive part of the "free energy" —\nZ does not depend on q as 
q > q c . So, the degree distribution N~ 1 5lnZ/5\iip (q) (see Eqs. (@) and ©) remains equal to its critical point 
value IT C (q). Consequently, the finite fraction of edges, q/q c — 1, is attached to an infinitely small fraction of vertices, 
forming a "condensate" , quite analogous to the one in the backgammon model jHHl. 

A specific form of the degree distribution at the critical point depends on the behaviour of this difference / (q) — q = 
o(q) as q — > 00. For example, for the so called "scale- free" distributions, II (q) oc as q — > 00 (7 > 2), we obtain 
fromEq. @: 

f(q)=q + l- 1 + 0{q- 1 ) (61) 
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at the critical point. For the same / (q) but for lower average degrees q < q c , we have II (q) oc xj q q~ 7 at large q. 
So, the state with a power-law degree distribution is marginal for the phase without the condensate of edges P7[ . 
(A "scale-free" state as a line between "generic" and "crumpled" phases on the phase diagram of trees was found 
in Ref. fill] , see also the condensation transition in the backgammon model (l5).) Our analysis has shown that the 
condensation takes place above q c p8| . Furthermore, the fat-tailed degree distribution is present also in the condensed 
phase. The problem of the condensed phase is more complex for the ensembles of Mayer's graphs, that is the ones 
without tadpoles and melons. The nature of condensation transition in such ensembles will be discussed elsewhere. 



VI. CONCLUSIONS 



Thus, we have developed the consistent description of random networks in the framework of classical statistical 
mechanics. Using the traditional formalism of statistical mechanics, we have constructed a set of equilibrium statistical 
ensembles of uncorrelated random networks and have found their partition functions and main characteristics. Wc 
have proposed a set of natural dynamical procedures, which generate equilibrium networks as a limiting state of the 
evolution, and have established a one-to-one correspondence between rules of these ergodic procedures and equilibrium 
ensembles of networks. This program has been realized both for directed and undirected networks. 

We have shown that a "scale-free" state (and fat-tailed degree distributions) in equilibrium uncorrelated networks 
without condensation of edges on vertices may exist only in a single marginal point. So, it is rather an exception 
p9| . This differs crucially from the situation for growing networks. The latter, while growing, may self-organize into 
scale-free structures in a wide range of parameters without any condensation. In summary, we have developed a 
statistical physics approach to equilibrium random networks. 

S.N.D. thanks PRAXIS XXI (Portugal) for a research grant PRAXIS XXI/BCC/16418/98. S.N.D. and J.F.F.M. 
were partially supported by the project POCTI/99/FIS/33141. A.N.S. acknowledges the NATO program OUT- 
REACH for support. We also thank V.V. Bryksin, A.V. Goltsev, A. Krzywicki, and F. Slanina for useful discussions. 

APPENDIX A: STATISTICAL WEIGHTS FOR THE MICROCANONICAL ENSEMBLE 

Initially, we have N vertices ("hedgehogs") with qi edges ("halves" of edges, speaking more precisely) protruding 
from an i-th one. Here we count the number of ways of connecting them in pairs to obtain a given graph with a given 
number of edges gij between vertices i and j. For vertices with unit-length loops ("tadpoles") we set gu to be equal 
to twice the number of such loops. The number of ways to choose gn,gi2, ■ ■ ■ giN edges from qi — gn + g^ + ■ ■ • + giN 
ones, attached to the i-th vertex is 



q,\ 



(Al) 



Then we have to connect in pairs gij dangling edges, attached to the «-th vertex, and gji = g^ edges attached to 
the j ^ i vertex. This can be done by gy! different ways. Also, the number of ways to join gu dangling edge s in 
pairs to form gu/2 closed loops is (gu — 1) (gu — 3) • • • 1 — (gu — 1)!!. Finally, combining together N multiples (Al) 
for each vertex, N (N — 1) /2 multiples gy\ for each pair of vertices, multiples (gu — 1)!! for each vertex, containing 
unit-length loops, and taking into account that (gu — l)!!/<fe! = we arrive at Eq. (|0|). 



APPENDIX B: INTEGRAL REPRESENTATION OF THE PARTITION FUNCTION FOR CANONICAL 

ENSEMBLE 



The partition function of the canonical ensemble is 



z c{ n,l)=n-l £ n^rr n i> ( B1 ) 

g en{N,L)i=i y "" j<k=i yjk ' 

where the set il (N, L) is a set of iV 2 non-negative integers <7y > with the following properties: (i) gu are even, (ii) 
gij = g^, and (hi) 
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N N N 



(B2) 



So, JV (JV + 1) /2 variables <7y, i > j, are subjected to the restriction (B2). Introducing 



(B3) 



one can write Eq. (Bl) as 
Z C (N,L) 



= JV 



-L 



N 

e n[(f> 



Sii/2 



{g}en(Af,L)i=l 



-1 / f)2 \ 9«/ 2 w 32 

^) n cwo- - 

j<k=l 



N 



dxjdxk 



n*(^) 



2'1 



(27V) 



L! 



i / N Q2 N Q2 

^2 al2 + 2 X! 



JV 



, dx\ .f^, dxidxj 



n*(^) 



xi- xn— 



(2AT 
L! 



-L / N 



2L 



N 



z=i 



where the relation (B2) was used. If we pass from x%, . . . ,xn to a new set of variables: x = (x\ 
difference variables yi = Xi — aii+i, i = 1, . . . , JV — 1, we have 



(B4) 

- xjv) /JV, and 



Then 



eta ' 9a; eta; ^— ^ fete; 

i— 1 i—1 



x=0 



Finally, one can write 



(B5) 



(B6) 



which is exactly Eq. (Eq). The contour c encircles the point x = 0. 



APPENDIX C: EVOLUTION EQUATION FOR THE DEGREE DISTRIBUTION 

Here we present a simplified derivation of the evolution equation for the degree distribution II (o, t). For example, 
we consider a network with the rewiring of edges according to the rules formulated in Section III for the canonical 
ensemble (for the grand canonical ensemble, the procedure is essentially the same). The total number of vertices, JV, 
and of edges, L, are fixed. With some probability n per unit time, a randomly chosen end of a randomly chosen edge 
is rewired to some vertex of the graph. This vertex is chosen from vertices of the graph with probability proportional 
to a given function / (qi) of the degree of the vertex. 

Then, the probability that a vertex i receives a new edge per time dt is 

f(qi)ndt nf ( qi ) 

E 3 f^)^ N JW)' 1 ) 



12 



In Eq. (CI) its left-hand side may be replaced with the right-hand side in the thermodynamic limit N — > oo (self- 
averaging) if the fluctuations of N (q) can be neglected. This is true for the equilibrium state (see Eq. (|l9|)), and so 
here we restrict ourselves to the nonequilibrium states that fulfill this condition. Then, the infinitesimal change of the 
degree distribution due to the rewiring of edges to a chosen vertex is 



Nf(q) 



[/ (q - l)U(q - l,t) - / (q)U(q,t)]dt . 



(C2) 



Also, we must take into account that the vertex may loose one of its qi edges, which will be rewired to another 
vertex. The probability nqidt/L that one of these edges is chosen for rewiring per time dt, must be multiplied by 1/2. 
This is the probability that of the two ends of the edge, the one attached to the i-th vertex, is chosen. Thus, the 
change of the degree distribution due to rewiring of edges from a vertex is 



M n (<z> *)]*on. = ]y= [(e + 1) n (? + 1, t) - «n (<?, t)} 



(C3) 



where q = 2L/N is the average vertex degree. Combining Eqs. (|C2j) and (C3) we arrive at the evolution equation 
N dU{q,t) 



dt 



=^= [/ (g - 1) n (q - 1, t) - / (g) n (g, t)} + ^[(q + l)U(q+l,t)-qU (g, t)} 



Looking for the stationary solution of Eq. (C4), one can easily find its first integral: 

+ 1, 



-II (q + 1) - £MlI (q) = const . 
/(?) 



One must set const = in Eq. (C5), because II (g) = at q < 0. Then we have 

U(q + l)=x s l^-U(q) , 



(C4) 



(C5) 



(C6) 



where we have introduced x s = qj f (g). The solution of Eq. (C6) is 



n(g) = c 



(C7) 



Here C and x s must be determined from the normalization condition and from the equality of the mean degree to a 
given value q — 2L/N: 



£n(g) = l, ^gn(g)=g. 

g=0 g=0 



(C8) 
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